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TRANSFORMATION FORMULAS RELATING GEODETIC 
COORDINATES TO A TANGENT TO EARTH, PLANE COORDINATE SYSTEM 

BY 

LEONARD CREDEUR 
SUMMARY 

In order to simulate an air traffic terminal area with dynamic 
deterministic traffic, the aircraft's body centered axes must be related 
to the geodetic site of navigation aides, runways, and other fixes 
for on-board navigation. In addition, the aircraft locations are 
shown as perceived by an airport radar. The approach used is to 
map geodetic positions to an earth tangent plane with an airport 
centered rectangular coordinate system. This report develops both 
the transformation equations and their approximations. The TCV 
program uses a different set of approximations to relate MLS derived 
aircraft positions to geodetic values for navigation. A short error 
analysis in appendix B shows the TCV approximations to be sufficiently 
close to the exact analytical expression for precision MLS navigation 
use. 







INTRODUCTION 


A Terminal Area Air Traffic Model (TAATM) was developed in conjunction 
with NASA's Terminal Configured Vehicle (TCV) Program. The principal 
objective of the TCV program is to increase the productivity of the 
aircraft/ai rport/air traffic control (ATC) system with primary emphasis 
on the airborne elements of the system. The TAATM provides a represent- 
ative real-time, mul tiple aircraft environment for both the TCV simulator 
cockpit and the TCV B-737 aircraft to interact with in the conduct 
of a wide range of experiments. In addition a fast time version of 
TAATM exists for computer batch processing. 

When simulating aircraft traffic within the confines of a typical 
terminal area airspace, the requirement of a simple coordinate system 
quickly manifests itself. One must relate the geodetic location of 
runways, navigation sites, fixes, etc. to the aircraft body-centered 
axis for navigation purposes and in addition show aircraft positions 
as would be perceived by an airport radar. This problem is simplified 
by chosing an airport centered rectangular coordinate system with an 
assumed flat earth surface. Though reducing the complexity of the navi- 
gation problem, this approach still requires the mapping of geodetic posi- 
tions to an earth tangent plane. The algorithms necessary for the mapping 
are the subject of the following discussion. 



SYMBOLS AND ABBREVIATIONS 


a 

A/C 

b 

e 

f 

h 

ho 




% 


% 

MLS 

MSL 

TAATM 

TCV 


semimajor or equatorial radius of the earth's ellipsoid 
aircraft 

semiminor or polar radius of the earth's ellipsoid 
eccentricity of the earth's ellipsoid 
flattening of the earth's spheroid 
height above mean sea level 

height above mean sea level of the rectangular coordinate origi 
at the airport 

local or Gaussian radius of curvature 
R|^ + ho 

radius of the circle defining north-south curvature of the 
earth's ellipsoid at a specified latitude 

Rm + ^0 

radius of the circle use to define east-west curvature of the 
earth's ellipsoid at a specified latitude 

R' + ho 

Microwave Landing System 
mean sea level 

Terminal Area Air Traffic Model 
Terminal Configured Vehicle 
geodetic or geographic latitude 
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(()' geocentric latitude 

((>0 reference latitude of TAATM coordinate orgin 

A(p change in latitude about the reference latitude 

Ao reference longitude of TAATM coordinate origin 
AA change in latitude from the reference longitude 
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DEVELOPMENT OF TRANSFORMATIONS 


Description of Earth's Ellipsoid Surface 

For navigation purposes the earth's sea level surface can be 
approximated by an ellipsoid of revolution around its spin or minor axis 
which is the diameter joining the north and south pole. The geometry of 


the ellipsoid is defined by an ellipse whose semimajor axis is the 
equatorial radius a and whose semiminor axis is the polar radius b, as 


shown in figure 1. The eccentricity of the elliptic section is defined by 


e 


2 



2 


( 1 ) 


and the oblateness or flattening of the spheroid as 
f- a - b 


( 2 ) 


The relation between e and f is 


e^= f(2 - f) 



(3) 


0 = goedetic latitude 
0'= geocentric latitude 
OA = a = seraimajor axis 
OB = b = semiminor axis 
P'P = h = altitude above MSL 


Figure 1. - Geocentric and geodetic latitude. 
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There have been several reference or standard ellipsoids used. 
Table I list some of these: 


Description 

Adopted by TCV for MLS Work 

FAA Route Development - US 
Army Engineers 

lAU - 1952 

NASA Values for Trajectory 
Calculations (NASA SP-7) 

lASU - 1965 


a (meters) 
6,378,169.79 
6,378,206.40 

6,378,388 

6,378,166+25 

6,378,160 


f 


3.3901 X 10"3 
3.3901 X 10"3 


1 

297 

1 

298.3 

1 

298.25 


TABLE 1. Reference Ellipsoid Approximations of Geoid 


From Figure 1 we see the geodetic (also called geographic or map) 
latitude (J) of a point P is the angle between the normal to the ellipsoid 
and the equatorial plane. For navigation purposes the radii of curvature 
of the ellipsoid are of primary importance. The meridian radius R^^ is 
the radius of the circle, of best north-south curvature fit to the meridian 
section of the ellipsoid at geodetic latitude (p. Its utility comes from 
the fact that a given relatively small north-south distance subtends approximately 
the same increment of latitude on a circle of radius R|^ as that north-south 
distance does on the geodetic ellipsoid at the reference latitude cj). 

The value R|^ and its approximation at some latitude cj) is determined in 
appendix A to be 


R 


M 


a(l - en 

(1 - e^ sin^tj)) 




(4) 


and 
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R,^ ~ aCl + (V 2 s1n2(|) - 1)J (5) 

The prime radius Rp, used to define the east-west curvature, is the 
radius of a circle model of the meridian section such that at latitude (f> 
its transverse circle of revolution around the polar axis is equal to that 
of the geodetic ellipsoid at latitude cj). From Appendix A we can write 


■P a-e%in%f 


and 


Rp ~ aCl + I sin^^)] 


( 6 ) 

(7) 


The local or Gaussian radius of curvature R^^, is the radius of the 
best fitting sphere to the ellipsoid at a local point. From Appendix A 
we get 

R - a (1 - 
^ 1 - e^sin^(|) 

and 

R, ~ a!Il - cos 2())] 

7 

Transformation from an Earth Tangent Plane, Actual Aircraft Projection to 
Geodetic Coordinates 

Let the TAATM origin at the airport be at reference latitude (J)o, 
longitude Ao and MSL altitude ho- The TAATM axis system is X-North, 
Y-East and Z down from the XY plane. From Figure 2, the point 
(x‘ , y' , z' = 0) on the flat plane through which a line passes from the 
X, y, z position to the local earth vertical is determined as follows: 


( 8 ) 


(9) 
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Figure 2. - Relation of TAATM tangent plane to earth coordinates. 
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Define ^ R|vi + ho 


then 

Z _ X - x' 





or 

1 r ^ 1 

(10) 


x' = x[1-z/r; + (z/R,^)" - (z/R^)^ +...] 


and 

x' x[l - z/R|(^] for z/R|J^ small 

01) 

likewise for 

R' A R^ + hu 


p = p 



^ 1 + z/Rp ^ 

(12) 

and 

y‘ ^y[l - z/R||j] for z/R'p small 

(13) 

With x' 

' and y‘ known exactly from (10) and (12) respectively and 

approximated in (11) and (13), the expression for Acj) and AA can 

be 

developed. 

Since the TAATM axes are X-North and Y-East then from figure 2 


A({) = arctan (^) = 

% ''m 


and 

AA = arctan (^4^ ) = —r ^ — 

Rp cos cj) R cos (j) 

^ ^ n 


for 

KJ 



+ A(p = radians north of TAATM origin 
+ A<}) A radians west of TAATM origin 


The corresponding geodetic coordinates in latitude and longitude 

are 


(f) = (p + A(j) 

(16) 

and 

A = Aq + AA 

(17) 
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Let us now consider the relation of altitude above sea level and the 
tangent plane height z at some arbitrary location (x, y) . For this we 
use the local or Gaussian radius of curvature. Figure 3 illustrates 
the relation of the quantities used. If ho is the height of the tangent 
plane's origin above MSL then the altitude h is 

h = ho + hi + ha ( 18 ) 


to determine hi and ha we define 

R|^ = R|^ + ho 

r^ = + y^ 


so that 


r 


r R. 


z + R 


T 

L 


We can then say 


(19) 


(Rl + ha)^ = (R')^ + (r')2 
ha = - R' + Rl [1 + (f^)"]^" 

ha = - R‘ + R'[l + (20) 

Determine hi from 


hi Rl + ha 

h, . z(l + 

hi = z [1 + (21) 

thus the MSL altitude h is 


h = ho + z[l + (- f+ hi )"]^ - R,' + R,'[l H- -)"]^ 

T z + Rl 


( 22 ) 
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Figure 3. - Relation of tangent plane I to MSL altitude. 
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this can be approximated by 


h ~ ho + z + 



(23) 


Transformation from TAATM Projection to Geodetic Coordinates 

We started with a generalized tangent plane actual aircraft projection. 
The exact transformation to geodetic coordinates are given by equations 16, 

17, and 22. It should be noted, as a result of either the exact equations 
for x‘ and y' (eqs. 10 and 12) or their approximations (eqs. 11 and 13), 
an aircraft with flat plane coordinates x, y, z 0 will have a different 
latitude and longitude from that of the flat plane coordinates x, y, z = 0. 
That is, an aircraft over a TAATM plane, ground navigation fix would have a 
different latitude and longitude from that of the fix. To avoid this 
problem for the TAATM simulation we will say x = x' and y = y‘. As a result, 
an aircraft at some altitude over a TAATM ground fix will have, after trans- 
formation, the same geodetic latitude and longitude as the transformed fix 
location. This is a reasonable simplification because of the distances 
considered (x, y ^ 50 n. mi), and for operational terminal area altitudes the 
ratios z/R|^ and z/Pp are small. 


When we set x = x' and y = y‘ for ground fix and aircraft latitude and 
longitude compatability the problem reduces to what is called gnomonic 
projection. Gnomonic projection is obtained by placing a plane tangent to 
the earth and projecting geoid points geometrically from the center of the 
earth. Figure 4 a illustrates this process. 

Since TAATM axis ar X-North and Y-East the distances are 
AN = X 

AE = y (24) 

For the gnomonic projection the relation between the TAATM distances 
AN and AE and that of latitude and longitude are 

AN 
R' 

M 


I 


= arctan 


(25) 



13 


Azimuthal Equidistant Projection 

Besides gnomonic projection, another approach employed for converting 
the curved earth to a flat plane is azimuthal equidistant projection. This 
is obtained by converting north-south and east-west radial or great circle 
distances to plane x, y. Figure 4b illustrates this projection. In this 
system the relation between the flat plane x, y distances and that of 
latitude and longitude (in radians) is defined by 


II 

-e- 

< 

(27) 

AA 

Rn cos 6 

(28) 


Looking back to Equations 25 and 26 we see that for small angles of A(j) 
and AA the gnomonic and azimuthal equidistant projection are approximately 
equal . 

TCV's Transformation Approximations 

Other approximations that those developed in this report have been used 
for mapping tangent earth plane positions to geodetic location. An example 
is the Terminal Configured Vehicle Program's approximation equations used to 
relate MLS derived position to geodetic latitude and longitude for on-board 
navigation. Appendix B contains a listing of their approximation equations 
and compares the results using these approximations with the output from the 
exact analytical expression derived earlier in this report. 
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■ b. Azimuthal equidistant projection 


Figure 4. - Geoid to flat plane mapping. 



CONCLUDING REMARKS 


The tran format ions developed for mapping geodetic positions to an 
earth tangent rectangular plane via gnomonic projection is a relatively straight 
forward process which simplifies the coordinate system requirements 
for simulating a terminal area air traffic environment. These 
requirements are to relate the geodetic positions of runways navigation 
sites, fixes etc. to the aircraft body centered axis to enable simulated 
aircraft to navigate, and also to display aircraft positions as would be 
detected by an airborne radar. Inverse transformation can be explicitly 
determined from the approximation equations developed. 

This report's development proceeded from a generalized tangent 
plane actual aircraft projection to that of a flat earth gnomonic 
projection. The generalized position projection represents the ideal 
position as perceived by a high frequency, line of sight system such as 
radar or the Microwave Landing System (MLS). Standard formulas may be 
used to transfer the spherical values of elevation, azimuth and range 
to the rectangular X, Y, Z. The generalized relation between geodetic 
position in latitude, longitude, and mean sea level altitude and the 
corresponding location in a rectangular flat plane X, Y, Z as developed in this 
report, provide a procedure to convert MLS values to geodetic position. The Terminal 
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Configured Vehicle Program used approximation equations to relate MLS 
position to geodetic values used by their on-board computer. Appendix B 
contains an error analysis comparison of the values obtained by the 
TCV approximation and the values obtained using our derived analytic 
expressions. Values of distance and altitude used in the error analysis and 
a representative range of values an aircraft would experience when landing at 
some air traffic terminal area. The results indicate the TCV approximations 
are adequate for precision MLS navigation use. 
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APPENDIX A 

DERIVATION OF ELLIPSOID RADII OF CURVATURE 


If a meridian section of the earth's ellipsoid of resolution is 
taken, the result is the ellipse shown in Figure A-1 . For a conventional 
X, Y coordinate system, the ellipse is 


where a is the semimajor (earth equatorial) radius and b is the semi’ 
minor (polor) radius. When the eccentricity e is defined by 
ea = - b^ 

then we can rewrite Equation A-1 as 

+ y't . = 1 

iP" a^(l-e^) 

Solving for y in Equation A-3 and differentiating with respect to x 
yields the slope y' at the point (x, y) on the ellipse, 
y' = (1 - e^)(- 


(A-1) 


(A-2) 


(A-3) 


(A-4) 


Since the geodetic latitude cj) at a point (x, y) is the angle between 


the normal to the ellipsoid and the equatorial plane 
y' tan cJ) = -1 


(A-5) 
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Substituting Equation A-4 into A-5 yields the relation 

y = x(l - e^)tan (|) 

Using A-6 in Equation A-3 results in 

a cos (j) 


(A-6) 


X = 


(1 - e^sin^cj))' 


(A-7) 


Taking Equations A-6 and A-7 together yields 

a(l-e^)sin(l) 

(1 - e^sin^cf))^ 

For the meridian radius R„, what is desired is a circle of radius R„ 

M M 

such that its north-south curvature or rate of change (second derivative 
of y with respect to x) at its latitude (f) is the same as that of the 
geodetic ellipsoid at latitude cf). 

The rate of change y'' of the ellipse at point (x, y) is determined 
by differentiating Equation A-4 with respect to x and using Equation A-5 
to obtain 


(A-8) 


i ( 1-e^sin^(l) v 

y sin^cj) ' 


Substituting from Equation A-8 yields: 

% 

a(l-e^)sin^^ 


v" = -(1-e^sin^^) 


(A-9) 


(A-10) 


A circle with its center at the origin of coordinates (X^ Y^) with 
radius R^^ has the equation 




(A-ll) 



For this circle the following relations hold 


y^' tan = -1 
tan ())c = 

c 

y = R„ sin (j) (A-12) 

•'c M ^c 

Using the relations of Equation A-12, the rate of change of the circle 

y '' is determined to be 
•'c 


•^c ~ Rm sin^d)^ 

■^c = M ^c 

If the circle is placed such that the point (x, y) of the ellipse in 

Figure A-1 and (x , y ) of the circle are the same for (j) = (j), then we 
c c c 

can rewrite Equation A-1 3 as 


(A-13) 


y 


c 


J 

Rj^Tin^ 


(A-14) 


Equating the rates of change in Equations A-10 and A-14 gives 

P ^ a(l-.el) 

^ (l-e"sin"(j))'^" 


(A-15) 


which is the radius of the best fitting circle for north-south curvature to 
the meridian section of the ellipsoid at latitude cji. Its utility comes 
from the fact that a given relatively small north-south distance subtends 
the same increment of latitude on a circle of radius R^^ as that south-north 
distance does on the geodetic ellipsoid at the reference latitude (p. 

If Equation A-15 is expanded in the form 


R^, = a(l-e^) [1 + (e^sin^cj))]" 


'M / LJ- ' OIII ly/j (A-16) 

and dropping higher order terms of e we get the following approximation 
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A similiar radius can be determined which relates the east-west 
curvature of a circle to that of the earth's ellipsoid. This radius, 
called the prime radius R , is defined as the radius of a circle model 

H 

of the meridian section such that at latitude <j>, its transverse circle 
of revolution around the polar axis is equal to that of the geodetic 
ellipsoid at latitude <p. 

From Figure A-2 we see this radius of east-west curvature is equal to 
the earth's ellipsoid value x at latitude (|). For an circle model of 
the meridian section the radius of rotation about the solar axis at 
latitude (|) must be equal to the value x. 

Rp cos (j) = X (A-18) 

When Equation A-7 is substituted into Equation A-18, the value Rp is 
determined in terms of the geodetic latitude (j). 

R = a (A-19) 

If Equation A-19 is expanded as it was in Equation A-16, the 
following approximation for Rp results 

2 

Rp ~ a[l + |- sin^(|)] (A-20) 

The local or Gaussian radius of curvature R|^, is the radius of the 
best fitting sphere to the ellipsoid at a local point 


(A-21) 




Figure A-2, - Relation of east-west curvature to a 
meridian section of geodetic ellipsoid. 


If Equation A-15 and Equation A-19 are substituted one gets 


R = 

^ (1 -e^sin^(|)) 


(A-22) 


If Equation A-22 is binomially expanded and higher order terms of e are 
dropped then we get for an approximation 
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APPENDIX B 

COMPARISON OF ANALYTICAL EXPRESSIONS 
TO TCVs APPROXIMATION EQUATIONS 

The Terminal Configured Vehicle (TCV) Program has used a number of 
approximation equations relating the earth's ellipsoid to a rectangular 
coordinate system in its Microwave Landing System (MLS) work (ref. 3). 
Following is a list of these equation; 

PARAMETERS OF TCV ELLIPSOID 
a = 6,378,169.79 meters 
f = 3.3901 X 10”^ 


APPROXIMATION EQUATIONS USED BY TCV 


= a[ ^ ] 

1 + f (2-3 sin^ (l)o) 

(B-1) 

= + ho 

(B-2) 

®h-f sin" (()o^' 

(B-3) 

= Rp + ho 

(B-4) 

® h+f(l-2 sin^(()o)^ 

(B-5) 

= R|^ + ho 

(B-6) 

II 

X 

(B-7) 

=y(i- ) 

(B-8) 

= x^ + y^ 

(B-9) 
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h = ho + z + 2 ^ 


A(p 


x' 



AX 


I 


= 

R cos (j)o 


(B-10) 

(B-11) 

(B-12) 


Table B-1 gives a comparison of results using TCV approximations 
and that obtained by using the exact expressions. For a chosen latitude 
of +40°, we used the lASU - 1965 reference ellipsoid and the exact 
analytical expressions of a generalized tangent plane actual aircraft 
projection derived in the report to obtain the following three values: 

1. the delta latitude from reference point 

2. the delta longitude from reference point 

3. height above mean sea level 

These were obtained for a rectangular tangent plane specific (x, y, z) 
point. A set of the above three values was obtained using the lASU - 1965 
reference ellipsoid together with the TCV approximation equations. Finally 
for the specific (x, y, z) point, another set of the previously mentioned 
three values was obtained using both TCV's ellipsoid and TCV's approximation 
equations. A comparison of the values obtained was made using the report's 
analytical expressions and the lASU - 1965 reference ellipsoid as the standard. 
The N/S and E/W errors in distance using the lASU - 1965 reference ellipsoid 
for calculated errors in Acji and AX was then determined using 

ERROR = Analytical Expression Value - Approximation Value 
This whole procedure was repeated for a range of x, y, z values. The resulting 
numbers in Table B-1 indicate that the TCV approximations are sufficiently 
close to the exact analytical expressions for precision MLS navigation use. 



TABLE B-1. COMPARISON OF TCV APPROXIMATION EQUATIONS AND ELLIPSOID 
VALUES TO EXACT EXPRESSIONS WITH lASU - 1965 ELLIPSOID 


MODEL FOR A LATITUDE OF 40“ 


Analyti cal 
Expression 
lASU - 1965 
El 1 ipsoid 


Radius of Curvature Values (meters) 


R 


M 


R 

R 


P 

L 


6,361,838.371 

6,386,999.409 

6,374,406.476 


Comparison for A/C at (x, y) = (5,5) 
h (ft) , 1644.130 

Acf) (rad.) 0.001455441 

AA (rad.) 0.001892459 

h error (ft) — 

N/S error (ft) — 

E/W error (ft) — 


TCV 

Approximation 
lASU - 1965 
Ellipsoid 


6,361,938.450 

6,387,008.141 

6,374,448.643 

n.mi . ; z = 1 ,600 
1644.133 

0.001455420 

0.001892458 

-0.003 

0.452 


TCV 

Approximation 
TCV Ellipsoid 

6,361,768.661 

6,387,116.270 

6,374,417.266 

ft; ho = 0 

1644.133 

0.001455459 

0.001892426 

-0.003 

-0.359 


0.010 


0.524 



TABLE B-1 Continued 


Comparison for A/C at 

X 

II 

o 

u 

o 

n.mi . ; z = 3,200 

ft; h„ = 0 

h (ft) 

3376.506 

3376.532 

3376.533 

A(() (rad.) 

0.002910654 

0.002910617 

0.002910695 

AX (rad.) 

0.003784615 

0.003784627 

0.003784563 

h error (ft) 

— 

-0.027 

-0.027 

N/S error (ft) 

— 

0.767 

-0.854 

E/W error (ft) 

— 

-0.187 

0.841 

Comparison for A/C at 

(x, y) = (15,15)n 

.mi.; z = 4,800 

ft; ho = 0 

h (ft) 

5197.106 

51797.198 

5197.200 

A(|) (rad. ) 

0.004365630 

0.004365591 

0.004365708 

AX (rad.) 

0.005676456 

0.005676506 

0.005676410 

h error (ft) 

— 

-0.092 

-0.094 

N/S error (ft) 

— 

0.818 

-1.614 

E/W error (ft) 


-0.808 

0.734 


Comparison for A/C at (x, y) = (20,20)n,mi . ; z = 6,350 


h (ft) 

7055.908 

7056.129 

A(j) (rad.) 

0.005820380 

0.005820357 

AX (rad.) 

0.007567985 

0.007568:114 

h error (ft) 

— 

-0.222 

N/S error (ft) 

— 

0.477 

E/W error (ft) 

— 

-2.070 


ft; ho = 0 

7056.133 

0.005820512 

0.007567985 

-0.225 

-2.765 


-0.013 



TABLE B-1 Continued 

Comparison for A/C at (x, y) - (30,30)n.mi . ; z = 9,500 ft; ho = 0 


h (ft) 

11138.016 

11138.791 

11138.799 

A(j) (rad.) 

0.008729109 

0.008729199 

0.008729432 

AA (rad.) 

0.011349974 

0.011350433 

0.011350241 

h error (ft) 

— 

-0.775 

-0.783 

N/S error (ft) 

— 

-1.888 

-6.751 

E/W error (ft) 

— 

-7.373 

-4.288 

Comparison for A/C at 

(x, y) - (40,40)n 

.mi . ; z = 12,750 

ft; ho = 0 

h (ft) 

15572.625 

15574.518 

15574.532 

A(j) (rad.) 

0.011636798 ' 

0.011637150 

0.011637461 

AA (rad.) 

0.015130483 

0.015131594 

0.015131338 

h error (ft) 

— 

-1.893 

-1.904 

N/S error (ft) 

— 

-7.346 

-13.828 

E/W error (ft) 

— 

-17.823 

-13.710 

Comparison for A/C at 

(x, y) - (50,50)n.mi. ; z = 16,000 

ft; ho = 0 

h (ft) 

'20409.500 

20413.309 

20413.331 

A(j) (rad.) 

0.014543366 

0.014544176 

0.014544564 

AA (rad.) 

0.018909362 

0.018911551 

0.018911231 

h error (ft) 

— 

-3.809 

-3.831 

N/S error (ft) 

— 

-16.910 

-25.011 

E/W error (ft) 

— 

-35.134 

-29.994 
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